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Abstract Random multiple-access protocols of type ALOHA are used to regulate 
networks with a star configuration where client nodes talk to the hub node at the same 
frequency (finding a wide range of applications among telecommunication systems, 
including mobile telephone networks and WiFi networks). Such protocols control 
who talks at what time sharing the common idea "try to send your data and, if your 
message collides with another transmission, try resending later". 

In the present paper, we consider a time-slotted ALOHA model where users are 
allowed to renege before transmission completion. We focus on the scenario that 
leads to overload in the absence of impatience. Under mild assumptions, we show 
that the fluid (or law-of-large-numbers) limit of the system workload coincides a.s. 
with the unique solution to a certain integral equation. We also demonstrate that the 
fluid limits for distinct initial conditions converge to the same value as time tends to 
infinity. 
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1 Introduction 

ALOHA-type algorithms are intended to govern star networks in which multiple 
client machines send data packets to the hub machine at the same frequency. Thus, 
collisions of packets being transmitted simultaneously are possible (clients know 
nothing about each other's intentions to transmit data and can not prevent collisions). 
Such algorithms assume the following acknowledgment mechanism. If data has been 
received correctly at the hub, which is possible only if no collisions occurred during 
its transmission, then a short acknowledgment packet is sent to the client. If a client 
has not received an acknowledgment after a short wait time, then it retransmits the 
packet after waiting a randomly selected time interval with distribution specified by 
the ALOHA protocol that governs the network. 

The pioneering ALOHA computer network, also known as the ALOHAnet, was 
developed at the university of Hawaii under the leadership of Norman Abramson 
(see 0], where Abramson first proposed the ALOHA multi-access algorithm). The 
goal was to use low-cost commercial radio equipment to connect users on Oahu and 
the other Hawaiian islands with the central computer on the main Oahu campus. 
The ALOHAnet became operational in 1971, providing the first demonstration of 
a wireless data network. Nowadays the ALOHA random access techniques are widely 
used in WiFi, mobile telephone networks and satellite communications. 

To give an example, we describe the conventional centralised time-slotted ALOHA 
model. Here "slotted time" means that users enter the system and abandon it, initiate 
and finish transmissions at times n = 1,2, The arrival process forms an i.i.d. se- 
quence {£, (n); n > 1}; all service times are assumed to equal 1. "Centralised model" 
means that the total number of users in the system is always known. Let Win) denote 
the total number of users at time n. For any n, at the beginning of the n-th time slot, 
which is the time interval [n,n + 1), each of the W(n) customers present in the system 
starts his transmission with probability p(n) (and does not with probability 1 —p(n)) 
independently of the others. If two or more users attempt transmissions simultane- 
ously, then the transmissions collide, and hence fail, causing the users to remain in 
the system in order to retransmit later. After a successful transmission the user leaves 
immediately. Note that, for any time slot, given there are m customers each starting his 
transmission with probability p, the probability of a successful transmission equals 
mp(l — p)'"~ l and is maximised by p = 1 jm. So we assume that p(n) = 1 /W(n). In 
such a setting, the population process {W(n); n > 0} forms a Markov chain that is 
positive recurrent if E<i; (1) < e~ l (the system is stable) and transient if (1) > <? _1 
(the system is unstable). Stability conditions for other ALOHA-type models can be 
found in lEHMH. 

In the present paper, we extend the framework described above by allowing im- 
patience of users. Each user knows how long he can stay in the system and abandons 
the system as soon as he succeeds to transmit his packet or his patience time expires, 
depending on what happens earlier. To distinguish between different levels of pa- 
tience we assume multiple customer classes. We also assume that the input process is 
non-trivial, i.e. P{^(1) > 2} > 0, and that E^(l) > e~ l . The latter condition would 
mean the overload regime if not for impatience of customers. 
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Abandonment before service completion is a very natural behavior in the case 
when waiting time exceeds some threshold because dwelling in the system means 
spending resources, and whatever one can imagine them to be: time itself, money, 
etc., there is always a limited amount of them at disposal. As for overload causing 
long waiting times, a system may experience it even if it is not expected to, due to 
fluctuations of the actual traffic from the designed traffic. These are the reasons of 
our interest in combination of the overload regime and impatience of customers. 

The results of the paper concern fluid limits for the workload process, i.e. weak 
limits that arise under a law-of-large-numbers scaling. We propose a fluid analogue of 
the stochastic model and, under mild assumptions, show that the family of the scaled 
workload processes is relatively compact with weak limit points a.s. satisfying the 
fluid model equation. Besides the last argument, we provide an independent analytical 
proof of existence of a fluid model solution for any initial state, and show that it is 
unique. We also demonstrate that there exists a unique equilibrium point for the fluid 
model equation, and that all fluid limits stabilise to this point as time tends to infinity. 

One of possible generalisations of the model treated in the present paper is to 
allow interference of transmissions only if the distance between the corresponding 
client machines is small, and this is a subject of our future research. Such an exten- 
sion of the network topology was proposed by Bordenave, Foss and Shneer in Q, 
where impatience of customers is not taken into account, though. The authors study 
fluid limits in order to find out whether the stochastic model is stable or not. The 
description of fluid limits for our model with impatience omitted coincides with the 
description of fluid limits in adapted to the network topology we consider here. 

The paper is organised as follows. In Section|2] we present a detailed description 
of the stochastic model. In Section[3] we define the fluid model solutions and formu- 
late their properties. In Section 2] we state our main result concerning convergence 
of sequences of the fluid scaled workload processes to fluid model solutions. Sec- 
tions|5]|6]and|7]contain the proofs of the results stated in Sections [3] and [4] Namely, 
in Section [5] we establish existence and uniqueness of a fluid model solution for any 
initial state. In Section [6j existence, uniqueness and global asymptotic stability of 
an equilibrium fluid model solution are shown. In Section Q we prove the result of 
Section|4] In the remainder of this section, we list the notation we use throughout the 
paper. 

Notation The standard sets are denoted as follows: the real line R = (— °°,°°), the 
non-negative half-line M + = [0,°°), the non-negative integers Z + = {0, 1,2, . . .}. All 
vectors in the paper are /^-dimensional with integer or real coordinates. The coordi- 
nates of a vector are denoted by the same symbol as the vector with lower indices 
\,...,K added. If a vector has superscripts, overlining, or tilde sign, they remain in 
its coordinates. For example, x° £ MS., x° — (x®, . . . ,Xg). The supremum and L\- 
norm in M. K are ||x|| = maxi<,<^ \xt\ and ||x||i = Y,f=i \ x i\> respectively. Vector in- 
equalities hold coordinate-wise. The coordinate-wise product of vectors is x*y — 
(x 1 y 1 ,...,x K y K ). 

The signs = and < st stand for weak convergence, equality in distribution and 
stochastic order, respectively. Recall that, for real-valued r.v.'s X and Y, X< st Y if 
P{X > t} < P{Y > t} for any t £ R. For an r.v. X having a distribution G, we write 
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X ~ G. The notations n(a), with a G (0,°°), and B(m,x), with m G Z+, x G [0, 1], 
are used for the Poisson distribution with parameter a and binomial distribution with 
parameters m, x. With B(0,x) we mean the degenerate distribution localised at 0. 
The complement of an event E is denoted by E. 

Forafunction /: S— >R K ,its supremum norm is = maxi< 1 </rsup, t . €s 
Let @ be the space of right-continuous functions /: [0,°°) -> R K with finite left lim- 
its. Endow this space with the Skorokhod J\ -topology. Let Sf be the class of continu- 
ous functions g : [0,°°) Rf such that \\g(t)\\ > for all t ^ 0. 

We use the signs := and =: to introduce a definition in the body of a formula. 



2 Stochastic model description 

This section contains a detailed description of the stochastic model under study. In 
particular, it derives the dynamic equation for the system workload. All stochastic 
primitives introduced here are defined on a common probability space (£1, Jp, P) with 
expectation operator E. The characteristic function of an event is denoted by I. 

Stochastic assumptions and the protocol We consider an ALOHA-type service sys- 
tem with impatient customers. The system includes a waiting room where customers 
arrive to, and a server. Time is slotted, i.e. arrivals and abandonments may occur only 
at time instants n = 1 , 2, . . . . Time slot n is the time interval [n, n + 1 ) . We assume that 
there are K < °° classes of customers. 

The arrival process is denoted by {A(n); n > 1}, where A (n) = (Ai(rc), . . . ,Ak (n)) 
and A;(«) is the number of class i customers arriving at time n. We suppose that 
{A(n); n > 1} is an i.i.d. sequence and that EA(1) =: A = (Ai,...,A#) G (0,oo) Jc . 
The coordinates of the vectors A(n) are allowed to be dependent. 

Let Wi(n) be the number of class i customers present in the system at time n > 0. 
As can be seen from the further description, Wj(n) coincides with the workload at 
time n due to class ;' customers. Hence, {W(n) = (W\ («),.. . ,Wk(>i)) ; n > 0} denotes 
the workload process. 

Each customer brings a packet that takes exactly a single time slot to be transmit- 
ted to the server. He also sets a deadline for transmission: once the deadline expires, 
the customer leaves the system even if his packet has not been transmitted yet. In this 
case, we say that the customer has abandoned the system due to impatience. Patience 
times of class ; customers have geometrical distribution with parameter pi and take 
values greater than or equal to 1 . By p we denote the vector having parameters pi as 
its coordinates, p = [p\,... ,Pk)- Patience times of different customers are mutually 
independent. 

We now describe how a transmission occurs. At the beginning of time slot n, each 
customer, independently of the others, starts transmission with probability 1 /|| W(n) || i 
(and does not with probability 1 — l/||W(n)||i). If there is one customer transmitting, 
then the transmission is going to be successful. Otherwise a collision happens. At 
the end of the time slot, customers learn the result. If a customer has succeeded to 
send his packet, he immediately leaves the system. If a customer has failed and he is 
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from class i, then with probability pi he leaves due to impatience, and with probabil- 
ity 1 — pi he stays in the system to try to retransmit his packet later. 
Throughout the paper we assume the following. 

Assumption 1 The input process is non-trivial, i.e. P{||A(l)||i > 2} > 0. 

Assumption 2 The mean amount of work arriving to the system per time slot ex- 
ceeds the stability threshold for the model with no impatience of customers, i.e. 

IIAUixr 1 . 

Remark 1 The results of the paper can be generalised onto the case when patience 
times are not simply geometrical random variables but finite mixtures of those. It 
suffices, for all i = l,...,K, to split customer class i into new classes, where fe, 
is the number of mixture components in the patience time distribution for class i 
customers. 

Workload dynamics The sequence {W(n); n > 0} forms a time-homogeneous Markov 
Chain. Its dynamics can be described as follows: given a history {W(m); m = 0,...,n} 
up to time n with W(n) = x, we have, for ;' = 1, . . . ,K, 

Wi(n + l)=x t +Ai - Ti(x) -Ii(x), (1) 

where 

. A = (A h ...,A K )=A(l); 

• T[(x) represents the number of class i customers who are present in the system at 
time n but will leave at the end of time slot n because of a successful transmission, 

T i (x)=l{B i (x) = l}l\l{B j (x)=0}, 

.m 

where B/(jc) ~B(jc ( -,1/||jc||i) if x ^ (0, . . . ,0) andfi,(0,...,0) =0; 

• U{x) represents the number of class ;' customers who are present in the system 
at time n but will leave at the end of time slot n due to impatience rather than a 
successful transmission; given x — T{x) = y, 

Ii(x)=B i (y)~B(y i ,p i y, 

• for any x, y <E Z^, the random vector A and the binomial r.v.'s B, (x), Bj (y), i,j = 
1, . . . ,K, are mutually independent. 

Remark 2 The number Tj(x) of successful transmissions by class i customers at a time 
slot may take only values and 1. Moreover, ||r(x)||i < 1. 
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3 Fluid model 

In the present section, we define a fluid analogue of the stochastic model described 
in the previous section. As time and space are appropriately normalised, we expect 
that the difference equation (fTJ can be approximated by a differential equation where 
the rate of increase is due to arrival rates, and the rate of decrease due to service 
completions and abandonments. In the single class case, one may expect such a dif- 
ferential equation to look like (we omit the class index) z'(t) = A — e _1 — pz(t ), since 
the throughput of ALOHA is e . In the multiclass case, this naturally extends to 

z'j(t) =Ai — e~ 1 Zi(t)/ (Lj=iZj( f )) —piZi(t), i—l,...,K. This will be made rigorous 
in Section|4] We now proceed more formally. 

Definition 1 For z° 6 M^, a solution to the integral equation 

z(t) =z° + tA-e~ 1 [ m(z{s))ds - p* [ z(s)ds, (2) 
Jo Jo 

that comes from Sf, i.e. that is continuous, non-negative and such that, for all t ^ 0, 
\\z(t)\\ > 0, is called a fluid model solution (FMS) with initial state z ■ The function 
m: Rf -»Rf is given by 



m(x) 



r x/\\ x \u if*^(o,...,o), 

\A/[[A||iifx=(0,...,0). 
Remark 3 For a function from Sf, equation (0 is equivalent to the Cauchy problem 

z'{t)=A~p*z(t)-e- 1 m(z(t)), (3) 
z(0)=z°, 

where (0 holds for t > if z° + (0,.. . ,0), and for t > if z° = (0,.. . ,0). 

Remark 4 Although m(0, ...,0) does not appear in 01, it needs to be defined for 
further use in Section 7. We assign to m(0, ...,0) the value of A/||A||i, which is 
the limit of m(-) along FMS's trajectories as they approach (0,...,0). Indeed, the 
only point where a fluid model solution can take the value of (0, ... ,0) is t = 0. Let 
z(-) be an FMS starting from z(0) = (0, . . . ,0). For the moment suppose that z(-) is 
continuously differentiable at t = 0. Then (0) and Taylor's expansion give, for small 
t >0, 



<«- A -"*>-'- , iE$a- 

where o(t) € R, o K (t) € R K , and o{t) /t 0, o K (t)/t ->■ (0, . . . , 0) as t 0. The con- 
tinuity of z'(-) at t = and Assumption [2] guarantee that L^LizJ(O) > 0, so we pass 
to the limit as t -> on both sides of © and get z'(0) = A - e"V(0)/ (Zf=i zR )) • 
The last equation has a unique solution z'(0) = (l — e~'/ ||A|| i) A, which implies ex- 
istence of the limit \im t ^Qm(z(t)) = A/||A||i. Later on (see Section|5] Property |2), 
we prove that, for any function z(-) from starting from z(0) = (0, ... ,0) and solv- 
ing (0, there exists the derivative z'(0) = (l — e _1 /ll^lli) an d hence exists the 
limit lim r ^ m(z(f)) =A/||A||i. 

In the remainder of the section, we discuss properties of FMS's. 
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Existence and uniqueness ofFMS's follow by the classical results from the theory of 
ordinary differential equations if the initial state is non-zero. Otherwise the proof is 
rather involved. The outline follows below; see Section|5]for the full proof. 

Theorem 1 For any initial state, a fluid model solution exists and is unique. 

One -dimensional case. Equation (O turns into (we omit the class index) z(t) = 
z° + (A — <? _1 ) t — p foz{s)ds, and its unique solution is given by z(t) = z°e~ pt + 
((A-e- l )/p)(l-e-P>). 

Multidimensional case, non-zero initial state. Uniqueness follows easily by the 
Gronwall inequality (see e.g. |9] Chapter EH, Paragraph 1]). 

Proposition 1 (Gronwall inequality) Suppose that functions u(-) and v(-) are non- 
negative and continuous in [a,b], and that there exists a constant C > such that 
v(t) <C + f a v(s)u(s)ds, a < t < b. Then v(t) < Cexp J* a ' u(s)ds, a < t < b. In partic- 
ular, ifC = 0, then v(t) = 0. 

Since the first order partial derivatives of the function m(-) are bounded on all sets 

Rf :={*GRf : ||*||>5}, 8 > 0, 

this function is Lipschitz continuous on all such sets. Let c(8) be a Lipschitz constant 
form(-)onRg with respect to the supremum norm, i.e. \\m(x) — m(x)\\ <c(8)\\x—y\\ 
foralljc,y GRf. 

Suppose that z(-) and z(-) are two FMS's with the same non-zero initial state. 
They are continuous and non-zero at every point, and hence, for each T > 0, there 
exists a 8(T) > such that z(t),z(t) G Rf (r) , < t < T. We put Az(-) = z(-) -?(•) 

and Am(z) = m(z) — m(z). Then —Az(t) = e~ l f Am(z(s))ds + p* f Az(s)ds, and, 
for t e [0,T], we have \\Az\\ [0j] < (e- l c(8(T)) + \\p\\) ^\\A Z \\ [0 ^ds. By the last 
inequality and the Gronwall inequality, we have ||Az||[o jf ] < 0, < t < T. Since T is 
arbitrary, z(-) andz(-) coincide on [0,°°). 

Existence of an FMS with a non-zero initial state can be shown by the Peano 
existence theorem (the proof is postponed to Section|5}. 

Multidimensional case, zero initial state. The techniques used in the previous 
case do not work here because they are based on the continuity properties of the 
function m(-) that fail as zero comes into play. So a different approach is required. We 
introduce a family of integral equations depending on parameters (e,a) G K+ x R5 
that includes (for (e,a) = (0,/?)) an equation equivalent to the Cauchy problem (O 
with z° = (0, ...,0). We show that each equation of this family has a solution. If 
£ > 0, then uniqueness of an (e, absolution is straightforward to show. In order to 
prove uniqueness of a (0, absolution, we derive a proper estimate for it via solutions 
with other parameters. The whole idea of this proof is adopted from [4|. 

Equilibrium FMS We now discuss existence, uniqueness and asymptotic stability of 
a constant solution to the fluid model equation (0. 

Definition 2 If a differential equation z'(f) = f(t,z(t)), t > 0, z,f G R K , admits 
a constant solution, then this solution is called an equilibrium point. 
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By means of a Lyapunov function, we prove the following result; see Section|6] 

Theorem 2 Suppose Assumption [2] holds. Then there exists a unique equilibrium 
point for the fluid model equation (0, which is given by 

z e ; = - — , i=l,...,K, where x solves Y\ — — - = llAlli — (5) 

x + pi g x + pi 

and any fluid model solution z(t) converges to z e as t — > oo. 



4 Main theorem 

In this section, we characterise the asymptotic behaviour under a fluid scaling of 
the workload process of the stochastic model introduced in Section [2] justifying the 
heuristics given in the previous section. First we specify the fluid scaling. Let R be 
a positive number. Consider the stochastic model from Section|2]with the impatience 
parameters pi replaced by pi/R, i £ {1, . . . ,K}. Denote the workload process of the 
R th model by W R (-), and scale it by R both in space and time, 

W R (t):=^W R ([Rt\), t>0. (6) 

We refer to the processes (|6) as the fluid scaled workload processes. They take values 
in the Skorokhod space l 3>. 

Remark 5 If the limit is continuous (which is the case whenever we prove conver- 
gence in & in this paper), then convergence in the Skorokhod J\ -topology is equiva- 
lent to uniform convergence on compact sets. 

Now we formulate the main theorem of the paper and highlight the basic steps of 
the proof; the detailed proof will follow in Section [7] 

Theorem 3 Let Assumptions Q] and [2] hold. Then any sequence of the fluid scaled 
workload processes W (•) such that W (0) => z° = const, R — > °° converges weakly 
in S# to the (unique by Theorem\J} FMS with initial state z°. 

The first step of the proof of Theorem|3]is to show that the fluid scaled workload 
satisfies an integral equation that differs from the fluid model equation (f2]i by negligi- 
ble terms (for R large enough). This appears to be the most difficult part of the proof. 
Then we obtain relative compactness of the family {W (•); R > 0} and continuity of 
its weak limits by applying a general result on relative compactness in '3. We also 
show that the weak limits are bounded away from zero outside t = 0, which, together 
with their continuity, implies that they a.s. satisfy the fluid model equation (0, and 
hence all of them coincide a.s. with the unique FMS with initial state z ■ 

Remark 6 In the literature on the fluid approximation approach, a fluid limit is any 
weak limit of the processes (JSJ along a subsequence R —> °°. As it follows from Theo- 
rem[3] for a sequence of the processes (|6) with W (0) z° = const, R—±°°, there is 
a unique fluid limit, and it is a deterministic function, namely, the fluid model solution 
with initial state z ■ 
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5 Proof of Theorem [T] 

We split the proof into two parts, for a non-zero and zero initial state. 
5.1 Non-zero initial state 

Here we have to prove the existence result only, see Section|3]for the proof of unique- 
ness. First we derive bounds for an FMS using the following lemma. 

Lemma 1 Let S be either a finite interval [0, T] or the half-line [0, °°), and let a real- 
valued function x(t) be continuous in S and differentiable in S \ {0}. Suppose that 
a constant C is such thatx(t) > C for t £ S\ {0} implies x'(t) < 0. Then sup reS x(/) < 
max{x(0),C}. 

Proof Let e > 0. Suppose that x(t) £ (max {x(0), C} , max {*(()), C} + e]. Then, start- 
ing from time t , the function x{t) is decreasing at least until it reaches level C. So 
sup (G5 x(f ) < max{jc(0),C} + £. Since e > is arbitrary, sup feS x(?) < max{jc(0),C} . 

□ 

Bounds for a fluid model solution Let S be either a finite interval [0, T] or the half-line 
[0,°°). Suppose that a function z(-) is non-negative with |z(-)||i > and continuous 
in S, and that it solves the fluid model equation (0 in S. Then \\z(t ) || i = Yj=\ Zi(t) and 
the derivative \\z(t ) || \ exists for all t G S. Summing up the coordinates of equation (01, 
we get 

HAlli,- 1 -p*\\z(t)\\i < IkWIli < HAlli-e- 1 -p*\\z(?)\\u * e s, 

where p % — mini <i<K Pi an d P* =ia 3Xi<i<KPi- ThenLemma[T]appliedtox() = ||z(-)||'i 
and C = (\\A\U -V l )jp^ andx(-) = -||z(-)||'i and C = (||A||i - e'^/p*, implies 
that 

sup || z (r) || !< max/ 1^(0)11!,^^) =:u(z(0)), (7) 
tes { P* J 

MIWOIIi^imnjll^ll^MLZflj = : /( z (0)). (8) 

By Assumption^ we have u (z(0)) > for any non-negative z(0), and I (z(0)) > 
for any non-negative and non-zero z(0). 

Inequality Q implies that z,(f) < A,- - e~ l u~ l (z(0))z,(f) - piZi(t), i=l,...,K. 
Then, by Lemma [T] we get 

supz,(0 < max {z, -(0), ^ ^ — } =: u, (z(0)) . (9) 

Similarly, if z(0) ^ (0,...,0), then inequality ([HJ and Lemma Q] yield, for i — 
I K. 

infz,(0 >rmn(z 1 (0),- T - T -^rrr— } =: k(z(0)) . (10) 
tes { e H l (z(0))+pi) 
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Remark 7 If z(0) # (0, . . . ,0), then, by the bound <[T0b and since 4(0) = A/ > if 
Zj(0) = 0, we have 

for all 8 > 0, inf min z, (f ) > 0. 

reS,;>Sl<KK 

Existence of a fluid model solution with a non-zero initial state The key tool used in 
this proof is the Peano existence theorem (see e.g. [9 Chapter II, Paragraph 2]). 

Proposition 2 (Peano) Suppose that a function /: Rx M. K — > R is continuous in 
the rectangle B = {(t,y): to <t < to + a,maxi<,<£ |jy z - — I < b} . LetM > and 
a = min{a,b/M}. Then the Cauchy problem 

y'(t)=f(t,y(t)), 
y(to)=y° 

has a solution in the interval [to, to + Of] such that y(t) £ B. 

First note that it suffices to show existence of a non-negative solution to equa- 
tion 01. By Remark[7] it will not hit zero at t > 0, and hence will be an FMS. 

Further note that it suffices to consider initial states with all coordinates positive. 
Indeed, if z(0) is non-zero, there exists a rectangle B = {maxi<,<A: |z< — Z;(0)| < b} 
that does not contain zero, and, consequently, the mapping /(•) = e m(-) + p is 
continuous in B. Let M = \\/\\b and a = b/M. By the Peano theorem, there exists 
a solution to equation 0) in the interval [0, a]. If z, (0) > 0, then, by continuity of z(-), 
there exists a t t < a such that Zi(t) > z, (°)A t <U. If Zi(0) = 0, then zj(0) = A; > 0, 
and there exists a f, < a such that z,(f) = A,f(l +o(l)) > hit/2, t < f,-. Therefore, 
with j3 = mini^KA-f;, we have inf,<p ||z(f ) || i > and Zj(j3) > 0, 1 < i < 

Suppose now that z, (0) > 0, 1 < i < K. We show that there exists a constant 
a* > such that any non-negative solution (•) to (0) that is defined in an interval 
[0, T] can be continued onto [0, T + a*] remaining non-negative (a* does not depend 
on T and z^ (■))■ This will complete the proof. Define the rectangle 

B* = {0 < U (z(0)) /2 < Zi < M( - (z(0)) + /j (z(0)) /2, 1 < « < /ST} 

and the constants 

M* = ||/]] B * J fc*= min/ ( (z(0))/2, a*=b*/M*. 

l<i<k 

Consider T = 0. Let S = {maXi<Kx |zj— Z/(0)| < b*}, then M* > ||/||b because 
Bq C5*. By the Peano theorem, there exists a solution to equation (0 in the interval 
[0, a*], and it is non-negative because Bq C R^. Consider T > and a non-negative 
solution z (r ' (•) to (0 defined in [0, T] . By the bounds (0 and ([10]), we have U (z(0)) < 

< m/ (z(0)), /= 1, . . . ,/sT.Letfir = {maxi<j<^ \zi -z ( p {T)\ < b*}, thenM* > 
[I/IIbj. because Bj C B*. By the Peano theorem, in the interval [0,05*], there exists 
a solution (') to me Cauchy problem 

y'(t)=A-p*y{t)-e- l m(y(t)), 

y(0)=z {T \T), 
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and it is non-negative because Bj C Mrt. Then 

z iT+a '\t): 
is a non-negative solution to (0 in [0, T + a 



z^ T \t), te[o,T], 

yV">(t-T), t e [T,T + a*] 



5.2 Zero initial state 

This proof is based on the ideas from [4|. We introduce a family of auxiliary integral 
equations parametrised by (e, a) G R + x Wi. By further Lemma|2] the equation with 
parameters (Q,p) is equivalent to the fluid model equation with zero initial condition. 
By PropertyQ] each auxiliary equation has a solution. By Property|3] for any a G M+, 
a solution to the equation with parameters (0,a) is unique. 

Lemma 2 (Equivalent description of the fluid model) For any initial state z°, the 
set of fluid model solutions coincides with the set of functions from §f that solve the 
following system of integral equations: for i = I,. . . ,K, t > 0, 



v (ID 

e- 1 \ 

dx ds. 



Ziit)= ^X Pit -Ilwh ds , 

+A { J^exp\-pi(t-s) -jf -J 



z(x)\ 



Proof As we differentiate equations (fTTT >. the fluid model equation (O follows. We 
now show that (O implies (fTTT >. Let z(-) be an FMS with initial state z° and consider 
the following Cauchy problem with respect to u(-): for i = l,...,K, 

K( t) =A i -( Pi+ ^y i{ t), t >o, (i2) 

Ui(0)=zl 

If (fT2l) has a continuous solution, it must be unique. Indeed, suppose that u(-), u(-) 
are two continuous solutions to (fT2l . Let w(-) =«(•)—«(•). Then, for i = l,...,K, 

w[(t)=-^ l+ ^ w y i{ t), t >o, 

Wi(0) =0. 

Lemma[T]applied to x(-) = w,(-) and C = 0, andx(-) = — w,(-) and C = 0, i = 1,...,K, 
implies that w(-) = 0. 

Finally, z() is a solution to (fT2l by (O. For i = 1, . . . ,K, t > 0, put f{t) to be the 
RHS of (fTTT >. Differentiating of /(•) implies that it is a solution to (fT2l . too. Since (fT2l 
has a unique continuous solution, z(-) and /(•) coincide, and hence z{ ) is a solution 

to CD}- □ 
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Auxiliary fluid model solutions and their properties For each (e,a) € R+ x in- 
troduce the operator ,f( £ >") : ( S~^- c S defined by 

F^' a \u)(t) = e+A i feKpl-a i (t-s) 




Hx)h 
?>0, i=l,...,K. 

Definition 3 Let (e, a) e R + x R^. A function z(-) e solving the integral equation 

z(t)=F^ a \z)(t), t>0, (13) 
is called an (e,a)-fluid model solution (for short, we write "(e,a)-FM5"). 

Further we establish a number of properties of the auxiliary fluid model solutions 
defined above, including existence and uniqueness of an (e,a)-FMS for any (e,a) 6 
R+ x Rf. 

For aeRf, put 

a* = max a,-, a* = min a,-, 

\<i<K 

a" = (a* ,a*), a 1 = (a*, . . . ,a*). 

Property 1 /« what follows, z' £,a '(-) denotes an (e,a)-FMS. 

(i) For any (e,a) G R+ x R+, f/zere exists an (e, a)-FMS. 

(ii) //£ > 0, f/ien a« (e,a)-FMS is unique. 

(iii) = . . . = ajf, f/ien a [Q,a)-FMS is unique and given by 



(\\A\\ x -e- l )t ifai=0, 



* M <H A IIAIh-e -1 < 14 > 
A. |A||3_«_ (1 _^ f) 

I ll A lli fl i 

(iv) Ife>8> 0, then z^' a) (t) > z {S ' a) (t), t > 0. 

(v) A (0,a)-FMS admits the bounds z {Q " u) (t) < z (0 ' u) (f) < z {Q ' J) {t), t > 0. 

Proof (i)for e > 0. Put z°(-) = (£,...,e) andz" +1 (0 = F^ e ' x \z")(-), n > 0. Then 
z 1 (0 >(£,•••,£)= Z°(0, * > 0. The operator F (£ ' a) is monotone, that is, u(t) > v(t) 
for all t > implies F( £ ' fl )(«)(f) > F^ a \v)(t) for all f > 0. Also F {£ '"\u)(t) < 
(e, . . . , e) +tA for all «(•) e and all f > 0. Hence, for each t > 0, the sequence 
{z"(f); n > 0} is non-decreasing and bounded from above, and there exists the point- 
wise limit of z"(-) as n — > °°; denote it by z(-). Now we show that z(-) is an (e,a)- 
FMS. Take an arbitrary t > 0. For all n > 0, we have z"( ) > (e, . . . ,e), and hence 
l/lk"(')l!i — 1/ (K £ ) ■ Then, by the dominated convergence theorem, for all s £ [0,t], 
f s e~ l /\\z n (x)\\idx — > f!. e~ l /\\z(x)\\idx as n — > °°. The last argument, together with 
exp(— aiif — s) — f s e~ { /\\z n {x)\\\dx} < 1, s 6 [0,?], and, again, the dominated con- 
vergence theorem, implies that F^ £ ' a \z n )(t) — > F^ £ '"\z)(t) as n — > °°. So, indeed, z(-) 
satisfies equation ( TTSl for all t > 0. 



Fluid Limits for an ALOHA-type Model with Impatient Customers 



13 



(ii) Letz(-) andz(-) be two (e,a)-FMS's. Take an arbitrary T > 0. Since a,(f — s) + 
j' s e- 1 /\\z{x)\\idx < (\\a\\ + (eKe)- l )T, < s < t < T, and the same is true for ?(•), 
by Lipschitz continuity of exp(-) on compact sets, there exists a constant a(T) such 
that, for t < T, 



\\z(t) -2(011 < a(T)e- l ££\l/\\z(x)h l/\\z(x)h 

<a{T)e- x rf l/||z(*)||i-l/||2(*)||i 
Jo 



dxds 
dx. 



Then, by Lipschitz continuity of 1 / 1| • || i on the set Mf and by the Gronwall inequality, 
z(-) and z(-) must coincide in all finite intervals [0,T], and hence they coincide on 

[0,oo). 

(iii) Due to Lemma|2l (0,a)-FMS's are defined by the Cauchy problem 

z'(t) = A-a lZ (t) -e- l z(t)/\\z(t)\\ u t>0, 
z(0)=0. 

Summing up its coordinates, we get the Cauchy problem 

IWOII'^dlAHi-O-flilWOIIi, f>o, 
lk(o)||i = o, 



which admits a unique solution 

l|z(0lli = 



(HAlli-e- 1 )?, if ai =0, 

(\\A\\ 1 -e- l )(l-e-^ t )/a l ,iSai > 0. 

In the case of e = and a\ = ... = ax, equation (IT3b implies that z(-)/lk(')lli = 
A/||A||i. Then the unique (0,a)-FMS is given by (fT4l) . 

(i)/or £ = 0, and (v). In order to prove existence, consider the sequence := 
z (°' aU )(.), := F(°' u) (z")(-), n > 0. By the reasoning analogous to that in the 

case of £ > 0, the point-wise limit of this sequence is a (0,a)-FMS. To prove the 
lower bound, consider the sequence z°(-) := z i0 ' a) (-), z" +1 (•) := F(°> flU )(z")(-), n > 0. 
It is non-increasing in «, and its point-wise limit is the (0,a u )-FMS. Thenz( '" l ')(f) < 
z°(f ) = z (0 a) (0 for all f > 0. Similarly, the upper bound holds. 

(iv) Consider the sequence z°(-) := z {S ' a) {-), z" +1 {-) := F( e - fl )(z")(-), « > 0. It 
is non-decreasing in n, and its point-wise limit is the (e,a)-FMS. Then z' £ > 
z °(t) = z {S ' a) (t) for all f >0. □ 

We proceed with properties of (0,a)-FMS's at t = (c/ Remark|4]i. 

Property 2 For anj (0 7 a)-FMS z^°'"\-), its right derivative at t — weW defined 
and (z (cu,) )'(0) = (l-e-7|[A||i)A. Afeo the limit lim r ^ o z (O ' u) (0/lk (O ' u) (0lli = 
A/||A||i exists. 
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Proof Here are three possibilities: either a* > a* > or a* > a* = 0, or = 0. 
We prove the property in the first case, the other two cases can be treated similarly. 
By Property [T] (iii) and (v), for i = 1, . . . ,K, t > 0, 

A, ||A||i -e- 1 ri „- a *,^ jo,a) ft ^ A, llAlli-e- 1 ^ 



(l-e- a ') <z) ' >{t) < t— - — — (1 -e- a *') 



||A||i a* 
Then, for any sequence t„ — > 0, n — > «, 

S°' a )( t \ A . 1 _ p-ajn A. 

li msU p£L^2 < (HaIIj Hm L_l = ^_ (^1, . 

„^oc f„ ||A||i 'b->~ a*f„ ||A||i 

Similarly, liminfn^ooZ,' '^^,,)/?,, > (A,/||A||i) (||A||i — e _1 ) . Hence, the derivative 
exists. The second result follows from Taylor's expansion, as was discussed in Re- 
markg] □ 

Finally, we show uniqueness of a (0,a)-FMS by estimating it via the auxiliary 
FMS's with other parameters. 

Property 3 Fix a G Mq_. For short, z £ denotes an (e,a)-FMS. 

(i) For e > and the function <p £ (t ) : = J Ke~ 1 / 1 1 z £ (s ) 1 1 1 ds, 

\\z e (t)-z°(t)h <e(K+\\a\\i + (p e (t)), t>0. (15) 

(ii) Ife > 0, £ — > 0, then E(p £ (t) —5- for any t > 0. 
(iii) A (0,a)-FMS is unique. 

Proof (i) Let £ > 0. By differentiating equation ( fT3l l. we get, for i = l,...,K, 

( z f)'(0 = A, - L + (zf (0 - e) » « > 0, 

z?(0) = e. 
Then integrating over [0,f] yields 

zf (0 - e = A,r - ^' ^ + (zf W - e) ^, « > 0, 

which, after taking the sum in all coordinates, can be rewritten as 

£zfW + L [ t a i zf(s)ds=(\\A\\i-e- 1 )t + eK+e\\a\\ l t + e(p e (t), r > 0. 



The last equation implies that, for e > 0, 

i ; (z £ (s)-z°(s))ds 

(16) 



=i 1=1 



£X" + £||fl||lf + £<p e (f), ? > 0. 
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Due to Property Q] (v), for e > 0, both sums in the LHS of ( TToT l have non-negative 
summands. By omitting the second sum, we obtain the bound ( TTBT l. 

(ii) Suppose that a* > (the other case can be treated similarly). Property [T] (iv) 
and (v), together with ||z £ (-)||i > Ke, implies that, for e > 0, 

P Ke ~ l , P Ke ~ l 



o ||z e (i)||i -yomax{ J fre,||z(°'« u )( i )|| 1 } 
By 0, ||z (0jflU H*)lli if and only ifs < /Ye) := — In „ iAlllZLf . We 

WM - -;w Q * j^l^ _ e _l _ K£a * 

have /(e) >0 fore small enough and /(e) ->0, e ->-0. Put j8 = i:e _1 /(||A[[i-e _1 ), 
then 

/■' 1 

e(p £ t = e- 1 f(e) + epa* — ds 



/(e) 1 - 

e - 1 /(e) + ej3 fl *ff-/(e) + ^-ln(l - « : ' 



-Si)( /(£)l "( 1 - e "°* /< ' 

In the very RHS of the last equation, convergence of the first two summands to as 
e — > is clear. The first multiplier of the last summand tends to a finite constant, and 
the second multiplier tends to 0. 

(iii) Suppose that z°(-) and z°(-) are two (0,7r)-FMS's. For any t > 0, by (i) 
and(ii), ||^(f) -z°(t)||i < lk (0-2 e (0lli + ]|z e (0-z (0lli ^Oase^O. Hence, 
Z°(-) and Z (•) must coincide in [0,°°). □ 



6 Proof of Theorem |2] 

Existence and uniqueness. The function f(s) = Yf=i Pi^-il ( s + Pi) is continuous and 
strictly decreasing in (0,°°), and takes all values between ||A||i and as s goes along 
(0,°°). Then, by Assumption [2] there exists a unique z e satisfying 01, and all its 
coordinates are positive. Equilibrium FMS's are defined by the equation 

A-p*z e -e- 1 z7||z e || 1 =0. (17) 

In order to prove the first part of the theorem, we have to check that (|5]l is a solution 
to d!71 l. and that, if there is a solution to d!71 l. then it is necessarily (0. 

By plugging 01 into ( TPTb multiplied by |z e || we obtain, for i = l,...,K, 

_ pjAj \ y Aj _ e~ l Aj _ AjX y Aj _ e^Aj 
x + pij^x + pj x + pi x + pip^x+pj x+pi 



Pi V J" ! X + pj J X + Pi \~ p x X + Pj 



So, indeed, (0 is an equilibrium FMS. 
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Suppose now that z e is a solution to (fTTT i. By solving coordinate i of (ITTb with 
respect to z?, we get 

7 e _ A,- 

' P/+^VIk e lli' '"" ■ 

Plug the last relation into the sum of the coordinates of (fTTt . then 

K 

E 



=1 

~e I 



Hence, z e satisfies (0 with x = e Vlk e H l- 

Stability. When proving the second part of the theorem, we refer to the following 
result (see E Chapter XIV, Paragraph 11]). 

Consider an autonomous system of differential equations 

z'(t)=f(z(t)), ?>0, z,/eR*. (18) 

Proposition 3 Suppose that the function f(z) is continuous in an open set E C Mr, 
and that, for any z(0) € E, there exists a unique solution z(-) to system (118b and 
z(t) £ E for all t > 0. Suppose also that there exists a non-negative continuously 
differentiable in E function V(z) such that V(z) — > 00 as \\z\\ — > °°, and the trajectory 
derivative of V (z) with respect to system (118b , defined by V ' {z) =Y.f=\ fi(z) dV / dzi(z), 
is non-positive. If there exists a unique point z where V'(z) — 0, then the solution 
z(t) = z of system (118b is asymptotically stable in E, i.e. any solution to dl8b with 
initial condition in E converges tozast—>°°. 

By Remark [7] and Property Q] (iii) and (v), any FMS at any time t > has all 
coordinates positive. Then it suffices to show convergence to the equilibrium point 
for FMS's that start in the interior of R+. This, in turn, follows from Proposition [3] 
with the open set E = (0, °°) K , equation © and the Lyapunov function 

K y 2 

y W = L -§■> whereyi := Zi — zf- 



=i*i 



By plugging y,'s into (0, we get 



z; = -PiJl + e- l T-^r- e~ \ - ■ 7 , i = 1, . . . ,K. 

Ik lb Ib+z Ik 



Z? -1 + 



Then, 



y w = L^5- = -L-=-- ii v , ^ii, L 



,=i ,=i \\y+^\h\ti4 llrf 

We have to check that V'(z) is non-positive on (0,°°) . For k= l,...,K, let 

i=l *i 2-,= 1 Zj 



Fluid Limits for an ALOHA-type Model with Impatient Customers 



17 



In particular, 

V , (z) = -t 2 -^l- 1 ^f—u K (y). (19) 

g Zf lb+z e lli 

The quadratic form UK{y) is non-negative on the set {y: y + z e € (0,°°) }, which 
we can shown by applying the Lagrange reduction to canonical form. We start from 
separating out the terms with yg and obtain 

Iterating the procedure for y^-i,. . . ,y2, we transform uiciy) into a sum of squares. 
Then, by (fT9l . V'(z) is non-positive on (0,°°)^. □ 



7 Proof of Theorem |3] 

The proof is organised as follows. Section l7TT1 contains a representation of the work- 
load process before and after the fluid scaling. In Section 17721 we formulate two aux- 
iliary results (Lemmas |3] and H), and then proceed with the proof of relative com- 
pactness of the family {W R (-); R > 0} and weak convergence (as R —> °°) along 
subsequences from this family. Proofs of Lemmas [3] and |4] are given in Sections [7.31 
and !7.41 respectively. 



7.1 Workload representation 

Throughout the proof, unless otherwise stated, we use the following representation 
of the workload dynamics: 

W R {n + 1) = W R (n) +A(n + 1) - T {n,W R (n)) - I R (n,W R {n)) , (20) 

where, for x G and i = l,...,K, 

fB^i/iwioaiDny^B^.i/iwioaoDif^^o, 

ftW_ \0 ifx = 0, 

Ti{n,x) =l{j>y(*) < U(n) < 

Xj-Tj(n,x) 

If(n,x)= £ tf(n,j), 

.7=1 

and 

• {U («); n > 0} is an i.i.d. sequence, and £/ (0) is distributed uniformly over [0, 1], 

• {^ R (n,j); j> 1 }, n > 0, i— 1, ... ,K, are independent i.i.d. sequences of Bernoulli 



r.v.'s, and P{|f (n, 1) = 1} = = 1 - P{£, R (n, 1) = 0}, 
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• the sequences {A(n); n > 1}, {U(n); n > 0} and {% R (n,j); j > l}, n > 0, i = 
l,...,K, are mutually independent and also do not depend on the initial condition 
W R (0). 
For short, we put 

0, x = 0, 

(l-l/;c)* -1 ,jt> 1. 
Then, in particular, 



*(*) = 



E 
E 



Pi {x) = h(\\x\\ l )m i (x), 
T (i,W R (i)) \w R (i)] = h{\\W R (i)\U) ™ (w R (i)) , 
I R (i,W R (i)) \w R (i)] =^(w R (i)-h(\\W R (i)\U)m{W R (i)) 



We now transform the workload dynamics into an integral equation that, as we 
show later, differs from the fluid model equation (|2} by the terms that vanish as 
For any n e Z+, we have 

W R (n)=W R (0) + tA(i)-"tT(i,W R (i))^£l R (i,W R (i)) 



i (=0 
n-\ 



■ W R (0)+nA-Y J h(\\W R (i)\\ l )m(W R (i)) 



i=0 



n-1 



(21) 



- ? * I K (0 - h 0^(0 111) « K(0) +M R (n), 

i=0 

where the sequence {M R (n); n > 0} forms a zero-mean martingale since 

M*( B ) = £fA(0-M(oV"£Yr(»,w J! (0)-E[r(i J ^(0) w*(i) 



i=l 
n-1 



£ i* (1,^(0) 



Introduce the fluid scaled version of the martingale {M R (n); n > 0} analogous to 
that of the workload process: 

W H (t) = ^W R {[Rtj), M H (t) = ±M R {[Rt}), 
Then equation (l2TT i turns into the integral equation 



W*(0 = W*(0) + ^A 
R 



(*||l^)[|l)m(W*(*))) 



(22) 



|»J/* 
/ IF* (,y) 
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Finally, we rewrite equation (l22t as 

t t 
W R (t) = W R (0) + 1 A - e- l Jm (W R (s)j ds - p* Jw R (s)ds + G R (t), (23) 



where 



G R {t) = M R (t) + G UR {t) + G 2 - R (t) + G XR {t), 

G ,* ( „=(M_,) A , 

t 

G 2R (t) = e- l Jm(W R (s)^ds 
o 

[R,\/R 

), 

R 



(!,...,!)-£ )* / h[R\\W R (s)\U )m(W R (s)) ds, 



G 3 - R (t)=p* J W R (s)ds. 



[Rt\/R 



7.2 Relative compactness and limiting equations 

We first discuss convergence G R (-) =>• (0, ...,0) as R — > °° in '3. By Remark [5] 
G l ' R (-) =>■ (0, . . . ,0) as R — > oo, Weak convergence to zero of the three other sum- 
mands in G (•) follows from Lemmas [3] and [4] 

Lemma 3 Let Assumptions\I]and\2\hold. Then 

(i) for any 8 > and £ > 0, there exists a y '= 7(5, e) > such that 

liminf P{(p R (yR) < 8R} > 1 -e, 

w/jere <p*(ytf) := inf{« > : W R {n) > 7/?}, 

(ii) /or any £ > ant/ A > 5 > 0, f/zere erafs a C = C(e, 5, A) > smc/z f/iaf 

liminf P( inf ||W" ff (f)||i > c\ > 1 -£, (24) 

(iii) G 2 ' R (-) => (0, . . . ,0) in 3 as R -> °°. 

Lemma 4 %?/?o«? W*(0) ^ z° a.? R ->• °°. r«e« G 3 -*(-) => (0, . . . ,0) and~M R (-) 
(0,...,0) ;'n 3> asR^>™. 
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Now we are in a position to prove the theorem. The proof consists of two steps. 
First, we establish relative compactness of a sequence {W R (-); /? — > °°} such that 
W (0) => z° (note that the assumption of z° being deterministic is not essential here, it 
is used in the next step). Second, we show that all weak limits of such a sequence a.s. 
coincide with the FMS starting from z°, which means convergence of the sequence 
to the FMS starting from z°. 

Relative compactness. We apply the following known result (see [6 Chapter 3, 
Corollary 7.4 and Theorem 10.2(a)]). 

Proposition 4 Let {X"(-); n > 1} be a sequence of processes with sample paths in 
S). Suppose that, for any TJ > and t > 0, there exists a compact set Y-q t C Mr such 
that 

liminfP{X"(f) er„ f }> 1-TJ. 
Suppose further that, for any r\ > and T > 0, there exists a 8 > such that 
limsupP{a)(X",5,r) > t?} < 77, 

where co(x,8,T) := max\<j<K s,up{\xi(s) — x,(f)| : s,t € [0, T], \t — s\ < 8}. Then the 
sequence {X n (-); n > 1} is relatively compact and all its weak limit points are a.s. 
continuous. 

Consider a sequence {W (•); R -> °°} such that W (0) => z°. By (EOj), we have 

< W R {t) < W R (0) + A{n) /R=>z° + tA, and the first condition of the propo- 
sition holds. Now we check the second condition. Equation ( l23l implies, for t > s, 

1 = l,...,K, 

Wf(t)-Wf(s) = K i {t-s)-e- 1 j t m i (W R (x)^j dx 
-p l J > W R {x)dx + Gf(t)^Gf(s). 
Since m,(-) < 1, we have, for t,s <E [0, T], \t — s\ < 8, 

\Wf(t)-W R (s)\ <A,8 + e- 1 8 + P MW R \\ m +2\\Gf\\ m . (25) 
Equation ( f23l also implies the following upper bound for the workload process: 

W R (t) < W R (0)+A it + Gf(t) < \\W R (Q)\\ + \\A\\T+\\Gf\\ m . (26) 
By (|23 and <|26]), 

co(W R (-),8,T)<(\\A\\+e- l )8 
+ \\p\\8 (\\W R (0)\\ + \\A\\T+\\G R \\ m ) +2||G ff || [0 , r] , 

which implies that the second condition of Proposition |4] holds, since 
and, by Remarkg] ||G ff ||[o r] =»0. 

Limiting equations. Now we show that, if {W R (-); R — >• °°} converges weakly in 
then its limit point W(-) a.s. 



Fluid Limits for an ALOHA-type Model with Impatient Customers 



21 



(i) is continuous, 

(ii) does not vanish at t > 0, 

(iii) satisfies the fluid model equation (0. 

Then, by uniqueness of FMS's, W(-) a.s. coincides with the FMS starting from z°. 

(i) Continuity ofW(-) follows from Proposition^ 

(ii) By Lemma[3] for any e > and n > 1, there exists a constant C(e, 1 /«,«) > 
such that liminffi^ooP{inf 1/ /„ <r< „ ||W (f)||i > C(e,l/n,n)} > 1 — e. In the inter- 
val (0,C(e, l/n,n)], choose a continuity point C(e,l/n,«) for the distribution of 
infi/ n<r< „ \\W(t ) || i. The mapping x(-) — > inf 1 /„<,< n ||x(f)|| is continuous in Sf\ hence, 

l-e<limP( inf |]W*(f)||i >C(e,l/n,n) } 

R^°o I 1 /n<t<n > 

= P{ inf ||W(0||i>C(e,l/»,»)}<p{ inf ||#(*)||i > o}. 

By taking the limits as £ — > in the last inequality, we obtain P{inf i/„<,<„ ||W(f)||i > 
0} = 1 for any n > 1, which, in turn, implies that 

p { 11^0) 111 >0forallf >0| = 1. (27) 

(iii) Fix t > 0. We introduce the mappings <p/ , (pf : @ — > R K defined by q>J (x) = 
x(t) + p* pQx{s)ds, <pf{x) — pQtn{x{s))ds. By Remark[5] the mapping <pj is con- 
tinuous at any continuous x(-). By m,-(-) <l,i=l,...,K, and the dominated conver- 
gence theorem, the mapping <p ( 2 is continuous at any continuous x(-) that differs from 
zero everywhere except the points forming a set of zero Lebesgue measure. Then, by 
continuity of W(-), d27b and the continuous mapping theorem, we have 

ri(W R ) + tf(W R )^<p t l (w) + tf(w). 

On the other hand, bv([23l>. 

<p/ (W R ) + tf(W R ) = W R (0) + tA + G R (t) => z° + tA. 
Since z° + tA is deterministic, we have, for any fixed t > 0, 

p{w(?) = z° + tA- e~ l jm (w{sfj ds - p-^W{s)ds} = 1 . 

Let ii, denote the event in the last equality. Then, again due to continuity of W(-) 
and (|23, 

p{w(-) satisfies © in [0,°°)} = p(p|n, over all rational t e [0,°°)} = 1. 
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7.3 Proof of Lemma[3] 

We split the proof into four parts. In the first two parts, we show that Assumptions Q] 
and |2] imply (i), and that (i) implies (ii), both for the single class case. In the third 
part, we show that the total workload \\W(-) \\\ of a multiclass model is bounded from 
below by that of a single class model with suitable parameters. Then (i) and (ii) hold 
for the multiclass case, too. In the last part, we show that (ii) implies (iii). 

Assumptions\T]and\2\imply (i), single class case For every /from an interval (0, y*}, 
we construct a Markov chain (see {Vy(n); n > 0} below) that, for all R large enough, 
is a lower bound for the workload process until the latter first hits the set [yR,°°). 
Then we choose a 7 so as to have (i) with {Vy(n); n > 0} in place of {W R (n); n > 0}, 
and this completes the proof. 

Throughout the proof, 8 and e are fixed. 

Without loss of generality, we can assume that, for all R, a.s. W R (0) = 0. Indeed, 

for all n and x > y, x — T(n,x) — I R (n,x) >y — T{n,y) — I R {n,y) a.s. (28) 

Property (f28) says that the process {W R (n); n > 0} admits path-wise monotonicity: 
the bigger is the initial value W^O), the bigger are all the other values W R (n), n>\. 
Further we make preparations needed to construct the lower-bound Markov chains. 

Let 

h* =e~ l + (A-e- l )/2 and B(k,l/k)({l}) <h*, k>N. (29) 

Let {#(«); n > 1} be an i.i.d. sequence with B(l) ~ B(N,p). 

We apply the following proposition (see the Appendix for the proof) with a = 
(A-e- l )/4. 

Proposition 5 For any a > 0, there exists ay* = 7* (a) and a family ofr.v.'s {9y\ < 
y< 7*} with the following properties: 

(i) the family {9y\ < J < 7*} is uniformly integrable; 

(ii) for any 7 € [0, J*}, E6 r < a; 

(iii) By 0o as 7 -> 0; 

(iv) for any 7 6 (0, 7*], there exists an Ry such that 9y > st B R ~B( [yR\ , p /R), R > R y . 

For 7 G (0, 7*], let {9 y {n)\ n> 1} be an i.i.d. sequence with 9y(l) = 9y, and assume 
that this sequence does not depend on {B(n); n > 1}. 

Now we construct the lower-bound Markov chains. For R large enough, given 

W R (n) <N, 

as N 

W R (n + l)-W R (n) >A{n + \) - 1 -£§*(n,!) > st A(l) - 1 -B(l), (30) 

!=1 

and, given N < W R {n) < yR, 

yy R \ 

W R (n + 1) - W R (n) > A(n + 1) - l{U{n) < h*} - £ £*(n,0 

1=1 

> st A(l)-I{C/(0) <h*}-6 7 . 
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Introduce the two i.i.d. sequences: 



x(n) =A{n) — 1 — B(n), n>l, 

y r (n)=A(n)-l{U(n-l)<h*}-e Y (n), n>l, (32) 



and the two auxiliary Markov Chains: 

vf(o) = o, 




max{0,V*(n)+Jt(n + l)} if V* (*)<#, 
max{0,y^(n)+y y (« + l)} if iV< V*(n) < yR, 
V*(n)+A(n + 1) u , . 

-V(i > v*(»))-^(».v;(»)) rfv rW>r^ 



f max{0, V r («) +x(n+ 1)} if V r (») < AT, 
rl + j \ max{0, V r («) +y r (n + 1)} if V r («) > JV. 

Put \j/ R (yR) and y/ r (yR) to be the first hitting times of the set [yR, 00 ) for the 
processes {V~ (n); n > 0} and {V r («); « > 0}, respectively. Then \\f R {yR) = Vy(yR) 
for all/?. 

The processes {V*(n); n > 0} and {W (n); n > 0} are related in the following 
way: Vf{n) = x, W R (n) = y, where x < y, implies W R (n + 1) > st V R (n + 1). Indeed, 
due to inequalities ( l28b . ( f30b and d3~TT ), 

W*(n+ 1) = .y+A(n + 1) -T(n,y) -I R (n,y) >x+A(/i + l) - T(n,x)-I R (n,x) 
> st max{0,x + x(n + 1)} = V^(« + 1) if x < N, 
> s , max{0,je+;y(n+l)} = V*(n + l) if N <jc< yR, 
= V*(n+l) ifjc>yR. 

Then we get (p R (yR) > st y R (yR) = y/y(yR) as a consequence of the following 
result (see the Appendix for the proof). 

Proposition 6 Suppose {X(n); n > 0} and \Y{n); n > 0} are Markov chains with 
a common state space ,5? , where 5^ is a closed subset ofR, and deterministic initial 
states X(0) < Y(0). Suppose also that, for any x < y and any z, 

P{X(n + l) >z\X(n) =x} <P{Y(n + l) >z\Y(n) =y}. 

Then there exist Markov Chains {X(n); n > 0} and {Y(n); n > 0} defined on a com- 
mon probability space, distributed as {X(n); n > 0} and {Y(n)\ n > 0}, respectively, 
and such that X(n) <Y(n) a.s. for all n. 

Now our goal is to choose a y € (0, y*] so as to have 

liminfP { y 7 {yR) < 8R} > 1 -e. (33) 

R — >°° 
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To track the moments when the process {Vy(n)\ n > 0} reaches level N from 
below and above, we recursively define the hitting times 

t} 0) = 0, xf = inf{« > v} !_1) : V y [n) >N), i>\, 

v { y ] = 0, = inf{« > xf : V 7 (n) < N}, z > 1. 

By convention, infimum over the empty set is °°. So, if either x$ = °°, or Vy = °°, 
then Xy — Vy — °° for all j > i. 

Note that the r.v. x^ :— Xy is a.s. finite and does not depend on y because, 
for n < tW, the process {V y (n); n > 0} is a reflected homogeneous random walk 
with i.i.d. increments {x{n); n > 1}, which do not depend on y. By Assumption Q] 
P{x(l) > 0} > 0, then EtW < °°. Further, for any i, if Vy is finite, then Ty* is 
finite, too, and the difference Xy : — Xy — v y is stochastically bounded from above 
byrW. 

Let qy — P{v|'^ < °°| Vy < °°}. Then there exists a constant q < 1 such that, 
for all i and y small enough, qy < q. (34) 

Indeed, for all y € [0, /*], consider the random walks Y y (n) := Y!i=\ yy(i) (here yo(n), 
n > 1, are defined by d32t with 7= 0). By Proposition [5] the family {yy(l); < 
y < 7*} is uniformly integrable, and yy(l) => yo(l) as 7 — > 0, which, together with 
Eyo(l) > (A-e _1 )/4 > 0, implies that inf„> T y (n) =>■ inf„> T (n) as 7^ (see |2] 
Chapter X, Theorem 6.1]). Also Ey (l) > implies P{inf„> Fo(»)} =: > 0(see [2 
Chapter VIII, Theorem 2.4]). Then, for all i, we have P{v} !) = °o|v}' _1) < 00} < 

P{inf„>oTy(n) > 0} — > po > 0, and, for all i and 7 small enough, qy < 1 — po/2 =: 
? < 1. 

Let A"y = inf{/ > 1 : v| ! ' = °°}. By ([34-b . the /Ty's are stochastically bounded from 
above by a geometric r.v. uniformly in 7 small enough, 

P{^y > i} < <T, i > 0. (35) 
Further, for i = 1 , . . . , Ky, define the hitting times 

v®=M{n>0: Y,Uy^y ] +j)>7R}- 

Since Ey r (l) > 0, these r.v.'s are finite. We have tyyiyR) < D ( -J 1 ('Ty +V« ). Indeed, 
if min{/ > 1 : ' - > v« ' } = k, then k<K y because Vy K ^ = °°, and 

WrijR) < 4 k) + vf = {x? - v} 0) ) + (v r l) -4*) + ...+ (x r k] - v«) + vf 
< f + f + . . . + + yf < ^ +y« + • • 4^+^. 
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Now we are ready to complete the proof. By (l35t . there are ko and y such that 
P{K y >k }<e for all 7 < 7. Put 80 = 8/(2k ) and 7=min{7*,7<5 (A-£>- 1 )/8}. 
Then 

PWyirR) > sr} < p{Lr = ,(^ ) + v?)i{K y > i} > sr} 

< Pfeef + V?)I{K r > > 8r\ + e 

1 ' (36) 

< YZx n^HKy > i} > m+IZi nWHKy > > SoR} +c 



bince {^7 > C {v^ 1 ' < °o} and is a.s. finite, 

tf < Pirfhiv^ < 00} > 80R} 

= P{lf > doR^-V < oolPjyt''- 1 ) < 00} (37) 
<P{t (1) >5o^}^0 asfl^°°. 

For z = 1, . . . we have {£^f J ^(t} + ./) > 7/?} C {v} < §)/?}. Then 

^ = P{v}' } > 8 R\K r > i}P{K r > i} 

<P{^ i yr(4' ) +j)<7R\Ky>i} (38) 
= P{Y r {[8oR\) < yR} -^0 as/?^oc 

because a.s. Y r {lS()R\)/R 5 Ey r (l) > 6o(A-e _1 )/4 > <5o7 
Finally, S, d37]i and 01 imply (f33]l. 

(i) implies (ii), single class case By (i), we can choose a 7 > such that, for large 
R, the process W (•) reaches level 7R in time (p R (yR) < 8R with high probability. 
Now we prove that, within the time horizon [(p R (yR), AR], there exists a minorant for 
W R (-) that, for large R, stays close to level yR with high probability. Then W R (•) stays 
higher than, for example, level yR/2. 

We now proceed more formally. Fix 8, A and £. Take /;* and N the same as 
in (|29T >. Take 7 and r.v. r that satisfy (i) of Lemma [3] (ii) (with a = (A- e~ l )/A) 
of Proposition |5] and (iv) of Proposition [5] Let {0(«); n > 1} be an i.i.d. sequence 

with 0(1) = 9y, and assume that this sequence does not depend on {A(n); n > 1} 
and {{/(«); n > 0}. Let {v^(n); n > 1} and {y(n); « > 1} be i.i.d. sequences with 

v R (n) =A(n)-I{U(n-l)<h*}-Z\=i £ fi (»- V) andy(«) =A{n)-l{U{n-\) < 
h*} — 0(n). Define the auxiliary processes 

( W R (n), n < <p R (yR), 

V R (n)=l [yR\, n = <p R (yR), 

{ min{ [yR],V R (n - l)+v R (n)} , n > <p R (yR), 



26 



M. Frolkova, S. Foss, B. Zwart 



and 



V*(0)=0, 

r(o) = o, 



V R (n) = min{0,V R («-l) +/(«)}, n > 1, 
F(n)=min{0,7(n-l)+y(n)}, n > 1. 



The processes W R (-) and V fi (-) coincide within the time interval [0, (p R (yR) — 1]. 
Starting from time (p R (yR), as long as V R (-) stays above levels, it stays a minorant 
for Indeed, for R large enough, given N < V H (z) < / = <p R (yR),. . . ,n, 

if W R (n) > [yR\, then, by (f28l>. 

W*(n + 1 ) >' [yR\ +A(n + 1 ) - T (n, [yR\ )-I R {n, [yR\ ) 
= [yR\ +v R (n + l) >V R {n + l), 

and,ifW R (n) < [yflj,then 

W R (n + 1) > W*(n) +A(n + 1) (n) < £*} -£^ J §*(n,i) 
>V R (n) + v R (n + l) >V R {n + l). 

Further, by independence arguments, for R large enough, y(l) < st an d 
mino<i<„3 / (/) < s t mmo<i< n V R (i). Since Ey(l) > 0, mino<(<„ Y(i)/n — > a.s. Hence 



Now we are ready to complete the proof. Put C = y/2 and define the events 



E R = {mm [SRi < n < m W R {n) < RC} } 
A R = {<p R (yR) < SR}, 

B R = {mino< ( .< LASJ V R (<p R (yR) + i) > 3yR/4}. 

Then P{E R } < P{E R HA R DB R } + P{A«} + P{B R }, where 

. E R r\A R r\B R ^{3yR/4 < min LMJ < B < LAfiJ W R (n) < yR/2} = 0, 

• limsup^^PjA*} < e, 

• by {V R ((p R (yR)+n); n > 0} ={V R (n) + [yR\ ; n > 0} and ([39), 

P{W} = P{min <„< LA «j V (») < 3yR/4 - [yR\ } -> as /? -y «. 



min y*(/)/.R=>0 asfl-> 

0<K|A«J 



(39) 



Hence, (ii) of Lemma (O holds. 
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Single class bound for a multiclass model Now we show that a model with multiple 
classes of customers can be coupled with a suitable single class model in such a way 
that the workload process of the single class model is majorised by the total workload 
of the multiclass model within the whole time horizon [0,°°). This, in particular, 
implies that statements (i) and (ii) of the lemma, proven in the single class case, are 
valid in the multiclass case, too. 

For the multiclass model, we slightly modify the representation of the workload 
process suggested in Section im We only change the terms that represent departures 
due to impatience. Forx € Z^, let 

Xi-Ti(nj)+...+Xi-T t (njc) 

I?(n,x)= £ l{u(n,j)<q}, 

j=x, —J] (nj)+...+Xt-i-Ti_ifax) 

where the r.v.'s U(n,i), i > 1, n > 0, are mutually independent and distributed uni- 
formly over the interval [0,1]. We also assume that the f/(n, i)'s do not depend on the 
random elements W R , {A(n); n > 1} and {£/(«); n > 0}. 
Consider a single class model with 

• initial condition W R (Q) = 11^(0)^, 

• arrival process A(n) = |jA(n)||[, 

• reneging probability p — maxi<,-<£ 

and define its dynamics as follows: 

W R (n+l)=W R {n)+A(n + l)-f (n,W fl (n)) -T R (n,W R {n)) , (40) 
where, for k G Z + , 

T(n,k) = I {£/(«) <h(k)}, 

and the r.v.'s U(n), U(n,i), n > 0, i > 1, are those defining the multiclass model. 
Then, in particular, 

\\T(n,x)\\ 1 ^{u(n)<Z« =1 pj(x)}=f(nMi), 

~ (41) 

l{u(nj)<%}<i{u («,;)<!}• 

We show by induction that W H (-) bounds ||W R (-)||i from below. Let N R (n) = 
||W R (n)||i -r(n,||W ff (n)||i), and suppose that W R (n) < ||W fi (n)||i a.s., then 

\\W R (n + l)\\ l >\\W R {n)\\ 1 +A{n + l)-T(n,\\W R (n)\\ l )- £ l{U(n,i) <p/R} 

i=i 

= \\W R (n)\\ 1 +A(n+ 1) -f(n, \\W R (n)\U) -I R (n, 

a >W R (n) +A(n + 1) - f (n,W R (nj\ -7 R [ii,W R {n)^j = W R {n + 1), 

where the first and last inequalities hold by (l4TT i and (l28l l respectively, and the identity 
is due to representation (l40l . 
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(ii) implies (Hi) By Remark[5] it is enough to show that, for any A > 0, i = 1, . . . ,K 

l|G-' K || [0 ,A]^0 as fl^oo. (42) 

Fix A, i. Recall that 

t AR'i/R 
G^ R (t)=e- l Jmf(s)ds- M - g J J h R (s)mf(s)ds, (43) 


where mf (s) = m,(7?W fl (i)) and h R (s) = h(R\\W (*)||i)- First, we estimate the sub- 
tractor in (|43V Since 7?||W fi (-)|| i is integer-valued and non-negative, h R (-) < 1. Also 
tnf (•) < 1. Then, for f < A, we have 

[Rti/R 

LR (s)mf(s)ds 



Jh R (s)mf(s)ds-(l-^ J h 



t [R'i/R 
J h R (s)mf(s)ds + ^ J h R (s)mf(s)ds<± + f 



[Rt\/R 

Take 5 < A, then 

mf(s)(e _1 -h R (s))ds 



ll[0,A] < — ^ + n sup 



Q<t<A 







< 1+P ' A + ( e -' + l)g + A sup I*" 1 — 

" 5<s<A 



(44) 



Now we show that 

x fl (5,A):=|| e - 1 -^(.)|| [ 5, A] ^0 as/?^oo. (45) 
For any a > and e > and C(5, A, e) satisfying d24"l) . 

{jc*(5,A) > a} c{jc*(S,A) > a, inf ||W*(*)||i >C(5,A,e)} 

uf inf ||W*(*)|[i<C(5,A,e)} 
c{ sup -/z(s)| > a\ 

ul^MjI^UKC^Ae)}- 
Here the first event in the very RHS is empty for R large enough, and hence 
limsupP{x fl (5,A) > ct} < limsuppj inf ||F S (i)||i < C(S, A,e)| < e. 

R^eo ff^oo U<.V<A J 

Since in the last inequality e > is arbitrary, for any a > 0, as R — >• °°, we have 
P{x*(<5, A) > a} -)■ , which is gU). 
Finally, d44ji and (@3]l imply d42l) . 
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7.4 Proof of Lemma|4] 

We prove the result in the single class case. The same proof is valid for each coordi- 
nate in the multiclass case. 

Convergence q/G 3rR (-) By Remark[5] it suffices to show that, for any T > 0, 



H K (T):= sup / W (s)ds=>0 asR^°°. (46) 

0<t<TJ[ R '\/ R 

Since W (•) is a constant function within the interval \[Rt J /R,t] , we have 

[TR\ 

Li R (T)=supW R (t)(Rt-lRt\)/R< sup W R {t)/R = W R (0)/R 2 + V A{i)/R 2 7 

t<T Q<t<T j = \ 

which implies d46b . 

Convergence ofM R {-) We represent the martingale {M R (n);n > 0} as a sum of three 
other zero-mean martingales, 

M R (n)=S R (n)-I R (n)~T R (n), 

n 

S R (n) = Y l A(i)-nA, 

n-lW R (i) 



**(»)= E I (V(*»-f), 



i=0 m=l 

n-l n-l W R (i) 

T R (n) = £ (r (i,W R (i)) -h(W R (i))) + £ £ - ^h(W R (i)) 

i=o i=o m=w R (i) K 

-T{i.W R (i)) + \ 

It suffices to show that, for N G Z + , N ^ °°, 

\X N (n)\ 

max J ^0, X = S, T,I. (47) 

1<«<JV N 

ForX = S, (l47b follows from the functional law of large numbers. 

For all n and N, we have | T N (n + 1 ) - T N («) | < 4. Then we get (gTJ with X = T 
by applying Doob's inequality for non-negative submartingales and the following 
known result (see e.g. [7 Chapter VII, Paragraph 9, Theorem 3]). 

Proposition 7 Let {X(n);n> 1} be a sequence of r.v.'s such that, for all n, 
E{X(n)\X(l),...,X(n-l)} = 0. 



Suppose that b(\) < b(2) <...—)• °° ant/ f/zaf YX=\b{k) EX(fc) < °° 77zen a.s. 

^n 
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Now we prove $47\ for X = I. The key tool of this proof is Markov's inequality. 
We have to show that, for any e > 0, as N — > °o, 



P{ max I N (n)/N>e}^0, 

l<n<Af 

P{ min I N (n)/N< -e}^0. 

l<n<N 



(48a) 
(48b) 



By Taylor's expansion, there exists an a* > such that, for any a E [0, a*], p £ [0, 1] 
and r.v. §(p) with P{<^(p) = l} = p = 1 -P{§(p) =0}, 



Ee «(?(p)-p) < e « 2 P. and Ee «(p-?(P)) < e « 2 P. 



(49) 



Since ^(n) < W^O) +Z? =1 A(i), n<N, and ^(0)/^ z°, and A(z)/JV -> A 
a.s., for any 5 > 0, there exists an M(8) G Z + such that 



limsupP{ max W N (n) >M(8)N} < 8. 

Af^oo 0<n<N 

Denote the event in d50b by E N (8) and put 

a(5) = min{a*,e/(2M(<5))}. 
We introduce the auxiliary martingale 



(50) 



(51) 



n-\W N ' S (i) 



***'(») = I L »>1, 

i=0 m=l JV 



where W^z) = max{W N (i),M(8)N}. Note that, on £^(5), we have I N < 5 (n) = 
I N {n),n = Q 1 ... 1 N. Hence, 



P{ max I N (n)/N>e] < P{ max 7*'*(jt) > eJV} + P{£ A '(<5)} 

\<n<N \<n<N 

<EL p K' 5 (»)>^}+p{^)}. 

By Markov's inequality, ( TfTT i and j49l , for n <N, 

exp(a{8)eN)P{l N - s (n) > eN} < Eexp(a{8)I N ' S {n)) 

W N (0),...,W N (n-l) 
<exp(a 2 (8)M{8)N). 



(52) 



E 



E 



J] EI ex P (oc(8)^ N (i,m)-p/N) 

L/=0 m=l 



(53) 



<E 



exp(a 2 (<5)^M(<5)W) 



By © and tfgTb . bounds (g3 and imply that 

limsupP{ max I N (n)/N > s} < 8, 

N^oo \<n<N 

where 5 > is arbitrary. Hence, convergence (148a) holds. Convergence (148bl ) can be 
treated similarly. 
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Appendix 

Proof of Proposition^ There exists an R* > such that, for all n E Z+, 7 G (0, 1] and R>R*, 

e"P{B* > n} < Eexp(B^) = (ep/R + l-p/R)^ < exp((e- l)p) =: /i. 

Take N* such that £ n>A ,« fin<; _ " < a/2, and 7* = min{l,a/(4p)}. Fix y 6 (0,y*]. Since, as R -> =», 
B( L/i?J,p/K) =^ n(7p), there exists an i? r > R* such that 

P{fi* = n} < 2n(rR)({n}), for R > R y and n = 0, . . . N* . 

For ye (0,7*], put 

P{0 y >,j} = tie-", n>W*, (54) 
P{9 7 = „} = min{2n(7R)({n}), 1 - P{9 r > n + 1}} , n = N*,...,0. 

For 7=0, put {54} and 

P{9 >0} = l-/te _iv * _I , 

P{e = n}=0, «=1,...,JV. □ 

Proof of Proposition^ Define 

^(JC, >z)=P{X(n + l) >z\X(n)=x}, 
Q(y, >z) = V{Y(n+l)>z\Y(n)=y}. 

Let {£/ (n); n> 0} be an i.i.d. sequence with U (0) distributed uniformly over [0, 1]. Then put 

X(0) =X(0), X(n+1) = sup{ z e,y': U(n) > i-P(X{n), >z)}, 

?(0) = F(0), Y(n+l) = sup{zey': U(n)>l-P(Y(n), >z)}. □ 
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